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ABSTRACT 



This study provides comparative data describing the quality 
of 1,175 psychological sites currently available on the Internet. A rating 
scale was used to assess six dimensions of site quality including accuracy, 
practicality, normalization and sense of belonging, referral, and feedback 
mechanisms. One-way ANOVA on the six separate quality items and summary 
scores revealed significant differences in the quality of ratings across the 
different topic categories. These categories were parenting problems, health 
problems, common emotional disorders, and severe mental illnesses. Sites 
addressing the needs of parents and those with health- related concerns 
received higher ratings; sites targeting the "worried well" and those with 
personality disorders received the least strong endorsements. Sites 
addressing the needs of those affected by severe mental illnesses received 
moderate ratings. The prevalence of commercial motivation affecting sites 
targeting the worried well appears to have compromised the quality of many of 
the sites. Overall, the ratings suggest that the average quality of the 
current sites was not impressive. Appendixes are "The Explosion of 
Psychological Help on the Net: Electronic Behavioral Healthcare," the 
original and revised evaluation form used in the study, and evaluation 
descriptions. (Contains 1 table and 114 references.) (MKA) 
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Abstract 

The Internet offers an entirely new means of providing 
psychological healthcare and access to psychological information. 
For mental healthcare consumers who possess the necessary 
cognitive and computer skills, the Internet literally opens up a 
world of treatment possibilities previously unimaginable. For 
consumers who are introverted, confined to the home, or who 
prioritize privacy, these remote forms of treatment and sources 
of information are extremely attractive. Unfortunately, the 
absence of regulatory measures concerning the quality of these 
sites could result in potentially harmful effects on the 
consumers' well being. This study provides comparative data 
describing the quality of 1,175 psychological sites currently 
available on the Internet. A rating scale was used to assess six 
dimensions of site quality including accuracy, practicality, 
normalization, and sense of belonging, referral and feedback 
mechanisms . 

One-way ANOVA on the six separate quality items and summary 
scores revealed significant differences in the quality of ratings 
across the different topics categories evaluated (Parenting 
Problems [ADHD, Tourette's Syndrome, Common Discipline Problems, 
Learning Disabilities, and Teenage Pregnancy] , Health Problems 
[Eating Disorders, Chemical Dependency, HIV/AIDS, Migraine, and 
Smoking Cessation] , Common Emotional Disorders [Anxiety 
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Disorders, Depression, and Post -Traumatic Stress Disorder] , 

Severe Mental illnesses [Schizophrenia, Bipolar Disorder, and 
Autism] , and Personality Disorders [Borderline Personality 
Disorder and Antisocial Personality Disorder] ) . Sites addressing 
the needs of parents and those with health-related concerns 
consistently received higher ratings, and sites targeting the 
"worried well" and those with personality disorders consistently 
received the least strong endorsements. Sites addressing the 
needs of those affected by severe mental illnesses received 
moderate ratings on most of the items. 

As previous studies have found (Morse, Doran, Simonin, 

Smith, Maloney, Wright, Underwood, Hoppel, O'Donnell & Chambliss, 
1998; DiBlassio, Simonin, DeCarolis, Morse, Jean, Vassalotti, 
Franks & Chambliss, 1998; Doran, Smith, Edwards, Hamilton, Morse, 
Hoppel & Chambliss, 1998), the prevalence of commercial 
motivation affecting sites targeting the worried well seems to 
have compromised the quality of many of these sites. In 
comparison, the quality of information offered by sites developed 
to assist parents seemed to be less distorted by a marketing 
agenda . 

Overall, the ratings suggested that the average quality of 
the current sites was not very impressive. The mean rating across 
problem topics for all site dimensions was 2.09 (s.d.=l.52, 
N=1175) on the 0-4 point scale, where 0=absent, i=extremely 
inadequate, 2=somewhat inadequate, 3=somewhat adequate, and 
4=outstanding . 



Introduction 

The Internet offers myriad opportunities to improve delivery 
of mental healthcare and enhance the lives of those affected by 
brain and behavioral disorders. The new electronic information 
technologies are fostering revolutions in how direct services are 
provided, and also facilitating optimal care indirectly, by 
keeping professionals more up-to-date and allowing larger-scale 
research on treatment effectiveness. In trying to improve the 
service delivery of providers while containing costs, many 
managed care companies offer long-distance educational 
opportunities via the Internet, with frequent updates reflecting 
new research findings. Use of the Internet can facilitate 
therapists' ability to draw upon state-of-the-art information 
about rarely encountered predicaments. 

Innovations in direct service delivery include the 
development of problem-specific lists that create de facto 
support groups, expert -mediated Websites that offer everything 
from virtual milieu therapy to parenting advice and electronic 
individual psychotherapy with therapists a nation away. For 
consumers who are introverted, homebound, or for when privacy is 
a priority, these remote forms of treatment are extremely 
attractive. For those with the requisite cognitive and computer 
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skills and the access to appropriate equipment, the Internet 
literally opens up a world of treatment possibilities previously 
unimaginable. The result is a growing optimism among treatment 
professionals concerning the future possibilities for the 
Internet. Sampson et al., (1997) envision the future 
"information highway" as providing clients in remote locations 
with access to a variety of specialists that would otherwise be 
unavailable. They predict that internet therapy will consist of 
a combination of counseling sessions by means of video 
conferencing and computer assisted instruction. 

Unfortunately the use of the internet does not only open up 
new possibilities; it also creates new problems. Kraut, 

Patterson, Landmark, Kiesler, Mukopadhyay, and Scherlis (1998) 
argue that this technology may inadvertently reduce social 
involvement and psychological well-being. Furthermore, the 
interaction of counselors and clients by means of electronic 
media presents myriad legal and ethical problems, including the 
obvious one of assuring confidentiality. 

The American Psychological Association's Ethics Committee 
adopted the following statement in 1995 regarding electronically 
provided psychological services. "The Ethics Code is not specific 
with regard to telephone therapy, teleconferencing, or any 
electronically provided services as such, and has no rules 
prohibiting such services. Complaints regarding such matters are 
addressed on a case by case basis. The nature of the contact is 
an important variable, and the use of telephone for purposes such 
as educative information, suicide hot lines, or brief crisis 
contact and referral are reasonably well established. The use of 
telephone for the provision of regular ongoing therapy or for 
diagnosis is not established, nor are such services as 
teleconferencing, Internet, or similar methods. Standard 1.04c, 
Boundaries of Competence, indicates that 'In those emerging areas 
in which generally recognized standards for preparatory training 
do not yet exist, psychologists nevertheless take reasonable 
steps to ensure the competence of their work and to protect 
patients, clients, students, research participants, and others 
from harm. ' Many of the enforceable ethical standards are, in 
fact, relevant to such services, and based on these standards it 
could be difficult for a psychologist to demonstrate that it is 
ethical to conduct therapy solely by telephone, teleconferencing, 
Internet, or similar methods ... Psychologists considering such 
services must review the characteristics of the services and the 
service delivery method, and consider the relevant ethical 
standards and other requirements, such as licensure board rules. 
As an example of the possible variations, consider 
confidentiality in a situation in which the services involve two 
individuals directly exchanging confidential information. The 
ease with which Internet transmissions may be intercepted would 
be relevant, and use of encryption might be considered a 
sufficient action on the part of the psychologist to establish 
that confidential transmissions were protected." 

Much of the extant literature pertaining to the Internet 
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within the field of psychology is descriptive in nature. The 
main focus of journal articles has been placed on the problems 
and technological limitations associated with the current 
Internet (e.g., Sampson et al . , 1997; Allen & Kostenbader, 1995; 
Frisse et al . , 1994) and projections about its eventual utility 
(e.g., Huang & Alessi, 1996; Sampson et al., 1997) . The subject 
of the Internet as it is currently being employed has been given 
little attention. 

In April 1996, Sampson, Kolodinsky, and Greeno (1997) sought 
to determine the prevalence of these resources on the Internet. 
Using the WebCrawler search engine they conducted a search of the 
word counseling. The results of this search showed the existence 
of 3,764 home pages containing that term. Further analysis of 
these pages showed that 45% of these sites pertained to 
psychological counseling and the rest were either not accessible 
or merely contained the word counseling somewhere in their text. 
Sampson et al. repeated this search in the same search engine 
only three months later and discovered that the number of home 
pages had grown to 4,584. That represents a 15% increase in 
three months. It is virtually impossible for both consumers and 
professionals to keep up with this rapid growth. 

Regardless of this problem, the use of the Internet as a 
supplement to traditional methods of counseling is in many 
respects a worthwhile endeavor. If counseling is defined as "a 
learning process designed to help people learn more effective 
ways of coping with their emotional, social, and career problems" 
(Sampson & Krumboltz, 1991) , then the use of the Internet as a 
means of disseminating information is valid. 

The recent explosion of behavioral healthcare resources on 
the Net has left many consumers and professionals overwhelmed. 

The Quality of Websites and lists is very uneven; no systematic 
mechanism exists to evaluate the utility of a given resource 
efficiently. Jacobson and Cohen (1997) have discussed the 
importance of teaching students to evaluate the quality of 
Internet sites. They argue that users of sites should consider 
all the dimensions of accuracy, comprehensiveness, currency, 
availability of hyperlinks, and the website's style and 
functionality. 

DiBlassio, et al.(i998), and Doran, et al (1998) found 
inconsistencies in quality across different categories of 
psychological sites. The current study extended this earlier work 
and examined the differential quality of five categories of 
behavioral healthcare sites on the Internet: Parenting Problems 
(ADHD, Tourette's Syndrome, Common Discipline problems. Learning 
Disabilities, and Teenage Pregnancy), Health Problems (Eating 
Disorders, Chemical Dependency, HIV/AIDS, Migraine, and Smoking 
Cessation) , Common Emotional Disorders (Anxiety Disorders, 
Depression, and Post Traumatic Stress Disorder) , Severe Mental 
Illnesses (Schizophrenia, Bipolar Disorder, and Autism) , and 
Personality Disorders (Borderline Personality Disorder and 
Antisocial Personality Disorder) . 
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Method 



Source and researchers 

Evaluations were conducted on a total of 1,175 web sites 
addressing the needs of five different target populations with 
psychological or behavioral health-related problems, including 
those with Parenting Problems (ADHD, Tourette's syndrome. Common 
Discipline Problems, Learning Disabilities, and Teenage 
Pregnancy) , Health Problems (Eating Disorders, Chemical 
Dependency, HIV, Migraine, and Smoking Cessation) , Common 
Emotional Disorders (Anxiety Disorders, Depression, and Post 
Traumatic Stress Disorder) , Severe Mental Illnesses 
(Schizophrenia, Bipolar Disorder, and Autism) , and Personality 
Disorders (Borderline Personality Disorder and Antisocial 
Personality Disorder) . The sites were chosen randomly from 
various common search engines on the Internet . Eleven trained 
undergraduate psychology majors from a small liberal arts college 
on the east coast completed the evaluations. After a period of 
training in the psychological problem areas (the bibliography 
includes a sampling of the literature used to familiarize 
students with the various problem areas) , each rater evaluated 
roughly 75-100 sites, pertaining to one of the five categories. 

Materials 

Several computers linked to the Internet served as tools for 
access to the Internet. A standardized evaluation form assessing 
6 separate dimensions was used to record the ratings for each 
site along with some demographic information. Evaluators were 
asked to rate how well each site provided the following: i) clear 
and accurate information 2) "how-to" suggestions for change: 
practical exercises or recommendations 3) destigmatizing 
information; promotion of normalization 4) promotion of a sense 
of belonging; information or activities to help combat loneliness 
5) referral mechanisms, if users found that additional help is 
needed and 6) a means of outcomes assessment; a feedback 
mechanism to assess the effectiveness of the site. 

The 1175 web sites were evaluated on the 6 dimensions using 
a 5-point scale ranging from zero to four. A zero indicated 
absent information or service, one indicated extremely inadequate 
information or service, two indicated somewhat inadequate, three 
indicated somewhat adequate, and four indicated the presence of 
outstandingly high quality information or service. The sites 
were evaluated over a period of six weeks. 

Results 

One-way ANOVA on the summary scores (created by totaling all 
6 measures of quality and dividing by 6) revealed significant 
differences in quality ratings across the five target categories 
(p< .001; F = 28.824; df= 4,1170) . On four of the assessment 
items, sites addressing the needs of parents consistently 
received higher ratings than other types of sites, and sites 
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targeting the "worried well" consistently received the least 
strong endorsements. Sites addressing health-related concerns 
received moderately high ratings on most of the items, while 
sites targeting the severely mentally ill were viewed as 
exemplary in providing feedback and referral mechanisms (relative 
to sites addressing other types of problems) . 

Additional ANOVA on the 6 separate quality items 
corroborated the general conclusions based on the summary measure 
findings (see Table 1) . Across the items, site quality was 
consistently highest among those sites directed at an audience of 
concerned parents, and lowest when members of the target audience 
were interested in common psychological problems such as anxiety 
disorders and depression. The prevalence of commercial 
motivation affecting sites targeting the worried well seems to 
have compromised the quality of this category of sites. In 
comparison, the motivation behind many of the sites developed to 
assist parents seems more compassionate and less exploitative; 
the quality of information offered by these sites seemed to be 
less distorted by a marketing agenda. 

Overall, the ratings suggested that the average quality of 
the current sites was somewhat disappointing. The mean rating 
across problem topics for all site dimensions was 2.09 on the 0-4 
point scale where 0=absent, l=extremely inadequate, 2=somewhat 
inadequate, 3=somewhat adequate, and 4=out standing. 



Discussion 

Sites addressing the needs of parents in assisting their 
children with various behavioral problems were consistently rated 
more highly than those in all other categories. Development of 
high quality sites for parents may in part derive from high 
levels of empathy for those struggling to help their children. 
Most parents seem to be instinctively inclined to seek help for 
their children's,- parents of those with problems are expected to 
go to great lengths to improve their children's well being. This 
contributes to a great demand for parenting information on the 
Internet. Apparently site developers have obliged, by creating a 
large number of reasonably high quality sites. 

In contrast, interest in common emotional disorders (anxiety 
and depression) is probably more modest. As a result, fewer sites 
have addressed this category of concern to date. Furthermore, 
many of the sites targeting the "worried well" population of 
depressed and anxious individuals seem to have an obvious 
commercial agenda. Their promotion of particular books, programs, 
and services was perceived by raters as often corrupting the 
quality of service, because sites often presented biased, 
misleading information about specific treatment options without 
including an objective examination of equally efficacious 
alternatives. Other studies have reported similar concerns about 
the potential exploitation of those with common emotional 
disorders (Morse, et al., 1998; Doran, et al., 1998) . 
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Although the information available on these sites varied 
considerably in terms of both quality and quantity, the Internet 
is still seen by these authors as providing many potential 
advantages for its users. Web sites provide information on 
prevalence, treatment, and detailed descriptions of symptoms 
characterizing specific disorders. Those suffering from various 
disorders easily find organized information in the privacy of 
their own homes. Web sites are generally used as a convenient 
starting point for research on particular problems. Often other 
Internet services, such as interactive lists are recommended as 
additional aides from these sites. Interactive lists provide 
patients with cutting edge information on treatments and current 
research on the disorder. In addition they are distributed 
globally, allowing many perspectives on the disorder to reach 
individuals (Allan & Kostenbader, 1995) . Subscription to these 
lists is usually cost free and provides subscribers with the 
option of asking professionals questions on various issues. 

Perhaps the most useful online services are the discussion 
groups for specific disorders. For example, through subscription 
to an on-line carrier, those suffering from Anxiety Disorders can 
receive support from their peers via computer. This service is 
especially helpful to those afflicted with Agoraphobia. The main 
symptom of this disease is a fear of being in any situation from 
which escape would be impossible in the event of panic attack. As 
a result, people who have agoraphobia are often unable to leave 
their home for weeks or months at a time, and seldom keep 
appointments with therapists. This inhibits their ability to seek 
treatment and support from others. On line support groups 
eliminate this fear while helping individuals to cope with their 
problems in a familiar environment. 

The Internet also provides many general advantages when 
compared to traditional treatment methods. Embarrassment and 
cost of treatment are common obstacles for those individuals 
suffering from mental health disorders. Many people are fearful 
of others knowing that they suffer from what they consider to be 
odd symptoms. The confidentiality established through the use of 
a computer can greatly reduced this fear. Those individuals that 
are unable to receive treatment because of the high price of 
healthcare are also within reach of treatment, through the 
Internet. Many sites and groups provide information on low cost 
or free mental health care. In addition, the use of Internet 
provides access with minimal cost. 

The Internet is a useful and accessible tool for providing 
mental health care,- however, specific goals and standards for its 
use must be met. Managed care organizations are already 
investigating means for reducing costs through computerized-based 
medical education, and such forces will further encourage the 
development of networked information resources (Huang & Alessi, 
1996) . By anticipating the potential abuses of the Internet by 
the health care systems, professional associations must assure 
that the information highway helps rather than harms clients. 
Although it would be beneficial for clients to be as 
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knowledgeable about their disorder as their therapists, 
inaccurate and inappropriate information could be detrimental to 
the outcome of their treatment. The validity of data delivered 
via computer networks needs to be screened prior to patient and 
public exposure (Sampson, Kolodinsky & Greeno, 1997) . Conversely, 
counselors need to be educated and trained in administering this 
treatment. With this advance in technology, in combination with 
expanding support groups and interactive lists, as well as 
professional therapist education and participation, cutting edge 
treatment for a variety of psychological problems may ultimately 
be accessed at the flip of a switch. 
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TABLE 1 



N 



Mean 



Promote Belonging Parenting 

Health 

Anxiety & Depression 
Severe Mental Illness 
Personality Disorder 
Total 



325 

310 

207 
125 

208 
1175 



2.32 
2 . 21 
1.43 
1 . 87 
1.41 
1.93 



Std 

Deviation 

1.39 

1 . 90 

1.43 

1.66 

1 . 59 

1.65 



Feedback 


Parenting 


325 


1.43 


1.56 


Mechanisms 


Health 


310 


2 . 11 


1.56 




Anxiety & Depression 


207 


1.08 


1 . 18 




Severe Mental Illness 


125 


2 . 50 


1 . 56 




Personality Disorder 


208 


1.68 


1.68 




Total 


1175 


1 . 71 


1.59 



Practical 


Parenting 


325 


2 .37 


1.39 


Suggestions 


Health 


310 


2 . 18 


1 . 59 


for Change 


Anxiety & Depression 


207 


0 . 99 


1.18 




Severe Mental Illness 


125 


1 .27 


1.53 




Personality Disorder 


208 


1 . 77 


1 . 50 




Total 


1175 


1.85 


1.53 


Clear and 


Parenting 


325 


3 . 11 


1.08 


Adequate 


Health 


310 


3 . 09 


1.21 


Information 


Anxiety & Depression 


207 


2 . 13 


1.27 




Severe Mental Illness 


125 


2 . 91 


1.33 




Personality Disorder 


208 


2 . 67 


1.36 




Total 


1175 


2 . 83 


1.28 



Promote 


Parenting 


325 


2.43 


1.29 


Normalization 


Health 


310 


1.88 


1 . 80 




Anxiety & Depression 


207 


1.52 


1.28 




Severe Mental Illness 


125 


2 . 11 


1 . 54 




Personality Disorder 


208 


1.60 


1.53 




Total 


1175 


1.95 


1.54 


Referral 


Parenting 


325 


2 .44 


1.50 


Mechanisms 


Health 


310 


2 .37 


1.55 




Anxiety & Depression 


207 


1.81 


1.35 




Severe Mental Illness 


125 


2 . 88 


1.38 




Personality Disorder 


208 


2.21 


1.59 




Total 


1175 


2.32 


1.52 
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ANOVA 





Sum of 
Squares 


df 


Mean 

Square 


F 


Sig. 


Promote 

Belonging 


between 

Groups 


180.816 


4 


45.204 


17.452 


.000 




Within 

Groups 


3030.593 


1170 


2.590 








Total 


3211.409 


1174 








Feedback 

Mechanisms 


Between 

Groups 


236.121 


4 


59.030 


25.437 


,000 




Within 

Groups 


2715.168 


1170 


2.321 








Total 


2951.289 


1174 








Pratical 
Suggestions 
for Change 


Between 

Groups 

Within 

Groups 


317.219 

2441.603 


4 

1170 


79.305 

2.087 


38.002 


.000 




Total 


2758.822 


1174 








Clear and 
Adequate 
Information 


Between 

Groups 

Within 

Groups 


154.249 

1759.057 


4 

1170 


38.562 

1.503 


25.649 


,000 




Total 


1913.306 


1174 








Promote 

Normalization 


Between 

Groups 


144.011 


4 


36.003 


15.886 


,000 




Within 

Groups 


2651.611 


1170 


2.266 








Total 


2795.622 


1174 








Referral 

Mechanisms 


Between 

Groups 


101.789 


4 


25.447 


11.414 


.000 




Within 

Groups 


2608.437 


1170 


2.229 








Total 


2710.226 


1174 









O 

ERIC 



11 



Page 6 



Bibliography 



Allan, R., & Kostenbader , P. Information on the Internet: 
how selective should we be?. Behavior Research Methods, 
Instruments, & Computers, 27, 198-199. 

Alloy, L. B., Acocella, J. , & Bootzin, R. (1996), Abnormal 
Psychology Current Perspectives. New York: McGraw-Hill Inc. 

American Psychiatric Association. (1993a) . Practice 
guidelines for eating disorders. American Journal of Psychiatry, 
150, 212-228. 

American Psychiatric Association. (1994) . Diagnostic and 
Statistical Manual of Mental Disorders. Fourth Edition. 
Washington, DC. 

American Psychiatric Association (1994) . Attention-Deficit 
and Disruptive Behavior Disorders. Diagnostic and Statistical 
Manual of Mental Disorders, 78-85. 

An Herbal Treatment for Migraines. (1997, 

November/December). Psychology Today, p.24. 

Apgar, B., (1996). Use of Desipramine for Treatment of 

Adult ADHD. American Family Physician, 55, 306-306. 

Azrin, N. , & Peterson, A. (1992) . An evaluation of 
behavioral treatments for Tourette's Syndrome. Behavior Research 
Therapy, 30, 167-174. 

Baird, P., & Sights, J. R. (1986). Low self-esteem as a 
treatment issue in the psychotherapy of anorexia and bulimia. 
Journal of Counseling and Development, 64, 449-451. 

Blanchard, E., Michultka, D., & Rosenblum, E. (1989). 

Stress management and Gilles de la Tourette's Syndrome. 
Biofeedback and Self Regulation, 14, 115-123. 

Blondal, T., Gudmundsson, L. J., Olafsdottir, I., 

Gustavsson, G. , & Westin, A. (1999) . Nicotine nasal spray with 
nicotine patch for smoking cessation: Randomised trial with six 
year follow-up. British Medical Journal, 318, 285-289. 

Bogenschneieder, K., Small, S., & Tsay, J. (1997). Child, 
Parent, and Contextual influences on Perceived Parenting 
Competence Among Parents of Adolescents. Journal of Marriage and 
the Family, 59, 345-362. 

Brandt, N., Hermesh, H. , Lauffer, M., Munitz, H., & Ratzoni, 
G. (1988) . Clomipramine Efficacy for Tics, Obsessions and 
Compulsions in Tourette's Syndrome and Obsessive-Compulsive: A 
Case Study. Biological Society, 27, 95-98. 

Braus, P. (1992, September). Migraine Misery: Whose Head 
Hurts Most. American Demographics, 14, 25-26. 

Brown, S. A., Gleghorn, A., Schuckit, M. A., Myers, M. G. , 
Mott, M. A. et al . (1996) . Conduct disorder among adolescent 

alcohol and drug abusers. Journal of Studies on Alcohol, 57, 
314-324 . 

Brown, T., & Liebowitz, M. The Empirical Basis of 
Generalized Anxiety Disorder. American Journal of Psychiatry, 

151 (9) , 1272-1280 . 



10 




12 



Bruun, R- D. (1994) . Gilles de la Tourette's syndrome, an 
overview of clinical experience. Journal of the American Academy 
of Child Psychiatry, 23, 126-133. 

Canals, J., Carbajo, G., Fernandez, J., Marti-Henneberg, C., 
& Domenech, E. (1996) . Biopsychopathological risk profile of 
adolescents with eating disorder symptoms. Adolescence, 31, 
443-451 . 

Carter, A. S., Cohen, D. j., Leckman, J. F., & Pauls, D. L. 
(1994) . A prospective longitudinal study of Gilles de la 
Tourette's syndrome. Journal of American Academy of Child and 
Adolescent Psychiatry, 31, 462-467. 

Cath, D., Roos, R., & Van de wetering, b. (1992). Mental 
play in Gilles de la Tourette's syndrome and Obsessive-Compulsive 
Disorder. British Journal of Psychiatry, 161, 542-545. 

Centers for Disease Control and Prevention. (1993) . 
Cigarette-attributable mortality and years of potential life lost 
-United States, 1990. Morbidity and Mortality weekly Report, 42, 
645- 649. 

Chambliss, C. (1996) . Peer consultation on the net: The 
problem of ex-clients who stalk therapists. Resources in 
education. ERIC/CASS, ED393048. 

Christen, A. G., & Christen, J. A. (1994). why is 
cigarette smoking so addictive? An overview of smoking as a 
chemical and process addiction. Health values: Health Behavior, 
Education, and Promotion, 18, 17-24. 

Cinciripini, P. M. , Lapitsky, L. G., Wallfisch, A., Mace, 

R., Nezami, E. & Van Vunakis, H. (1994) . An evaluation of a 
multicomponent treatment program involving scheduled smoking and 
relapse prevention procedures: Initial findings. Addictive 
Behavior, 19, 13- 22. 

Cohen, D. J., & Leckman, J. F. (1994). Developmental 
psychopathology and neurology of Tourette's syndrome. Journal of 
the American Academy of Child and Adolescent Psychiatry, 333, 

2-15 . 

Cole-Detke, H., & Kobak, R. (1996) . Attachment processes 
in eating disorder and depression. Journal of Consulting and 
Clinical Psychology, 64, 282-291. 

Coley, R. L., & Chase-Lansdale, P. L. (1998). Adolescent 
Pregnancy and Parenthood. American Psychologist, 53, 152-166. 

Compas, B. E., Haaga, D. a., Keefe, F. j., Leitenberg, h., & 
Williams, D. A. (1998) . Sampling of empirically supported 
psychological treatments from health psychology: Smoking, chronic 
pain, cancer, and bulimia nervosa. Journal of Consulting and 
Clinical Psychology, 66 (1), 89-112. 

Compton, N., Duncan, & Hruska, J. (1986). How Schools Can 
Help Combat Student Pregnancy. Washington, D.C.: National 
Education Association. 

Constantino, J. N. , Morris, J. A., & Murphy, D. L. (1997). 
CSF 5-HIAA and family history of antisocial personality disorder 
in newborns. American Journal of Psychiatry, 154 , 1771- 1773 . 

Davidson, J. R., Malik, M. L., & Sutherland, S. N. (1997). 
Response Characteristics to Antidepressants and Placebo in 

11 




13 



Post-traumatic Stress Disorder. International Clinical 
Psychopharmacology, 12, 291-296. 

Davis MD, L. L., Suris Ph,D., a., Lambert MD, M. T. et. al. 
(1997) . Post-traumatic Stress Disorder and Seratonin: New 
Directions for Research and Treatment. Journal of Psychiatry and 
Neuroscience, 22, 318-326. 

DiBlassio, J., Simonin, D., DeCarolis, A., Morse, L., Jean, 
J., Vassalotti, L., Franks, K., Chambliss, C. (1998) Educational 
Resources Available on the Internet: Assessing the Quality of 
Psychological Healthcare Sites. Perspectives in Mental Health 
Journal . December. 

Dolan, B. (1991). Cross-cultural aspects of anorexia 
nervosa and bulimia: A review. International Journal of Eating 
Disorders, 10, 67-78. 

Doran, M., Smith, A., Hoppel, A., Morse, L., Edwards, M., 
Hamilton, J., Simonin, D., Maloney, C., Underwood, M., O'Donnell, 
S., Wright, C., Chambliss, C. (1998) Informing Students About The 
Variable Quality of Psychological internet Resources: Sites 
Targeting Substance Abuse Problems, Emotional Disorders, and the 
Needs of Parents. Resources in Education . ERiC/CASS. 

Durand, V. M., Barlow, D. H. (1997) . Abnormal Psychology: 
An Introduction. Pacific Grove, California: Brooks/Cole. 

Felker, K. R., & Stivers, C. (1994) . The relationship of gender 
and family environment to eating disorder risk in adolescents. 
Adolescence, 29, 821-835. 

Flynn, P. M. , Craddock, S., Luckey, J. w., Hubbard, R. L., & 
Dunteman, G. H. (1996) . Comorbidity of antisocial personality 
and mood disorders among psychoactive substance-dependent 
treatment clients. Journal of Personality Disorders, lO, 56- 67. 

Frisse, M. E., Kelly, E. A., & Metcalfe, E. S. (1994). An 
internet primer: resources and responsibilities. Acad Med, 69, 
20-24 . 

Garvey, MD, M. J., Tollefson, MD, PhD, G. D., & Schaffer, 

MD, C. B. (1984) . Migraine Headaches and Depression. American 
Journal of Psychiatry, 141 (8), 986-988. 

Gay Men's Health Crisis. (1998). Gay Men's Health Crisis 
Homepage. Internet URL: 

http : / /WWW . gmhc . org/s topping/basics . htm#whatisaids (version 
current at November, 1998) . 

George, M., Ring, H., Robertson, M., & Trimble, M. (1993). 
Obsessions in Obsessive- Compulsive Disorder with and without 
Gilles de la Tourette's Syndrome. American Journal of 
Psychiatry, 150(1), 93-97. 

Goldstein, L. (1998, January/February) . Headaches with a 
Family History. Psychology Today, p.i4. 

Gowen, J. W., Cristy, D. S., & Sparling, J. (1993). 
Informational Needs of Parents of Young Children with Special 
Needs. Journal of Early Intervention, 17, 194-210. 

Greenlund, K. J., Liu, K., Dyer, A. R., Kieffe, C. I., 

Burke, G. L., & Yonis, C. (1996). 

Body mass index in young adults: Associations in parental 
body size and education in the CARDIA study. American Journal of 




12 



Public Health, 86, 480- 485. 

Gross, J., & Rosen, J. C. (1988) . Bulimia in adolescents: 
Prevalence and psychosocial Correlates. International Journal of 
Eating Disorders, 7, 51-61. 

Hancock, L. (1996). Mother's Little Helper. Newsweek, 
51-56 . 

Herman, C., Flor, h., & Blanchard, E. B. (1997). 

Biofeedback Treatment for Pediatric Migraine: Prediction of 
Treatment Outcome. Journal of Consulting and Clinical 
Psychology, 65 (4), 611-616. 

Himmelfarb, G. (1997) . Revolution in the Library. The Key 
Reporter, 62(3), p.3. 

Hines, A. (1997) . Divorce-Related Transitions, Adolescent 
Development and the Role of the Parent -Child Relationship: A 

Review of the Literature. Journal of Marriage and The Family, 

59, 375-388. 

Holm, K. (1996, May) . Making The Kids Pay. Writers 
Digest, 76(5), 48-55. 

Huang, M., & Alessi, N. (1996). The Internet and the 
Future of Psychiatry. American Journal of Psychiatry, 153(7), 
861-869. 

Jacobson, T. E. & Cohen, L. B. (1997) . Teaching Students 
to Evaluate Internet Sites. The Teaching Professor, ii, 7, 4. 

Johnston, L. D., O'Malley, P. M. , & Bachman, j. G. (1996). 
National survey results on drug use from the monitoring the 
future study, 1975-1995: Volume 1, Secondary school students. 
Washington, DC: U.S. Dept of Health and Human Services. NIH 
publication 96- 4139. 

Joiner, G. W., & Kashubeck, S. (1996). Acculturation, body 
image, self-esteem, and eating-disorder symptomatology in 
adolescent Mexican American women. Psychology of women Quarterly, 
20, 419-435. 

Jorenby, D. E. et . al (1999). A controlled trial of 
sustained-release bupropion, a nicotine patch, or both for 
smoking cessation. New England Journal of Medicine, 340, 685-691. 

Kneedler, R. D. (1984) , Special Education for Today. New 
Jersey: Prentice-Hall Inc. 

Koran, L., Thienemann, M. , & Davenport, R. The Quality of 
Life for Patients with Obsessive-Compulsive. American Journal of 
psychiatry, 153(6), 783-788. 

Kraft, M. K., & Dickinson, J. E. (1997). Partnerships for 
improved service delivery: The Newark target cities project. 
Health & Social work, 22, 143-148. 

Kraut, R., Patterson, M., Landmark, V., Kiesler, S., 
Mukopadhyay, T., & Scherlis, w. (1998) Internet paradox: A social 
technology that reduces social involvement and psychological 
well-being? American Psychologist, 53, 9, 1017-1031. 

Kruger, L. j., Cohen, S., Marca, D., & Matthews, L. (1996). 
Using the internet to extend training in team problem solving. 
Behavior Research Methods, Instruments, & Computers, 28, 248-252. 

Lamm, MD, S. S. (1982), Learning Disabilities Explained. 

New York: Doubleday & Co. INC. 



13 




15 



Lauren, MA. , j. (1997), Succeeding with Learning 
Differences. Minnesota: Free Spirit Publishing. 

Laws, A. & Golding, j. (1996) . Sexual assault history and 
eating disorder symptoms among white, Hispanic, and 
African-American women and men. The American Journal of Public 
Health, 86, 579-583. 

Leavy, J. (1996) . With Ritalin, the Son Also Rises. 
Newsweek, 59. 

Lerman, C., Caporaso, N. E., Audrain, j.. Main, D., Bowman, 

E. D., Lockshin, B., Boyd, N. R. & Shields, P. G. (1999). 

Evidence suggesting the role of specific genetic factors in 
cigarette smoking. Health Psychology, 18, 14-20. 

Leutwyler, K. (1996) . Paying Attention. Scientific 
American, 12-14. 

Lewis, S. F., Piasecki, T. M., Fiore, M. C., Anderson, J. 

E., & Baker, T. B. (1998) . Transdermal nicotine replacement for 
the hospitalized patient: A randomized clinical trial. Preventive 
Medicine, 27, 296-303. 

Lonsdale, J. (1996), The Hatherleigh Guide To Psychiatric 
Disorders. New York: Hatherleigh Press. 

Marcus, M. B. (1997, April 7) . Parent Lessons. US News 
and world Reports, 122, 13, 72. 

Marshall, R. M., Hynd, G. W., Handwerk, M. J., & Hall, J. H. 
(1997) . Academic Underachievement in ADHD Subtypes. Journal of 
Learning Disabilities, 30, 635-642. 

McDevitt, T. M. (1996) . Trends in Adolescent Fertility and 
Contraceptive Use in the Developing world. U.S. Bureau of the 
Census. Washington, D.C.: U.S. Government Printing Office. 

Mintz, L. B., & Betz, N. E. (1988) . Prevalence and 
correlates of eating disorder behaviors among undergraduate 
women. Journal of Counseling Psychology, 35, 463-471. 

Morse, L, Doran, M., Simonin, D., Smith, A., Maloney, C. , 
Wright, C., Underwood, M. , Hoppel, A., O'Donnell, S., & 

Chambliss, C. Preferred Psychological internet Resources for 
Addressing Anxiety Disorders, Parenting Problems, Eating 
Disorders, and Chemical Dependency, Resources in Education . 
ERIC/CASS, CG028198, 1998. 

Myers, M. G., Stewart, D. G., Brown, S. A. (1998) . 
Progression from conduct disorder to antisocial personality 
disorder following treatment for adolescent substance abuse. 
American Journal of Psychiatry, 155, 479-485. 

Myers, P. N., Jr., & Biocca, T. A. (1992) . The elastic body 
image: The effect of television advertising and programming on 
body image distortions of young women. Journal of Communication, 
42, 108-133. 

National Center for Health Statistics. (1996). Teen Birth 
rates Drop for Third Straight Year -But Still at Record High. 
Public Health Reports, ill, 471-472. 

National Institute of Allergy and Infectious Diseases. 

(1998) . National Institute of Allergy and Infectious Diseases 
Homepage. Internet URL: 

http://www.niaid.nih.gov/factsheet/aidsstat.htm (version current 




14 



at November, 1998) . 

National institute on Drug Abuse. (1998) . National 
Institute on Drug Abuse Research Report Series. Internet URL: 
http: //www.nida .nih.gov/research reports/nicotine/nicotine2 .html 
(version current at March, 1999) . 

Nelson, K. et . al . (1996) . Changes In Sexual Behavior and a 

Decline In HIV Infection Among Young Men In Thailand. The New 
England Journal of Medicine, 335, 297-303. 

O'Brien, M. (1996) . Child Rearing Difficulties Reported By 
Parents Of Infants and Toddlers. Journal of Pediatric 
Psychology, 433-446. 

Ogata, S., Silk, K., Goodrich, S., Lohr, N., westen, D., & 
Hill, E. (1990) . Childhood Sexual and Physical Abuse in 
Borderline Patients. American Journal of Psychiatry, 147, 1008- 
1013 . 

Orr, T. (1994, December) . The Hidden Parenting Market. 
Writers Digest, 74, 12, 41- 44. 

Oullette, J. A., & Wood, W. (1998) . Habit and intention in 
everyday life: The multiple processes by which past behavior 
predicts future behavior. Psychological Bulletin, 124 (1), 54-74. 

Penick, E. C., Powell, B. J., Campbell, j., Liskow, B. I., 
et al. (1996). Pharmacological treatment for antisocial 
personality disorder alcoholics: a preliminary study. 

Alcoholism: Clinical and Experimental Research, 20, 477-484. 

Price, J. H., Beach, P., Everett, S., Telljohann, S. K., & 
Lewis, L. (1998) . Evaluation of a three- year urban elementary 
school tobacco prevention program. Journal of School Health, 68 
(1) , 26-31. 

Reed, D. K., & Hresko, W. (1981), A Cognitive Approach to 
Learning Disabilities. New York: McGraw-Hill. 

Robenstine, C. (1995) . Providing HIV/AIDS Education for 
African American High School Students. High School Journal, 78. 

Robinson, K. L., Price, J. H., Thompson, C. L., & 
Schmalzried, H. D. (1998). Rural Junior High School Students' 
Risk Factors For and Perceptions of Teenage Parenthood. Journal 
of School Health, 68, 334-339. 

Rott, M. P. P. (1990) . Disordered eating in women of 
color. Sex Roles, 22, 525-536. 

Rosen, L. W., Shafer, C. L., Drummer, G. M., Cross, L. K. , 
Deuman, G. W. , & Malmberg, S. R. (1988). Prevalence of 
pathogenic weight-control behaviors among Native American women 
and girls. International Journal of Eating Disorders, 7, 807-811. 

Sabol, S. Z. et . al. (1999) . A genetic association for 
cigarette smoking behavior. Health Psychology, 18 (1), 7-13. 

Sampson, J., Kolodinsky, R., & Greeno, B. (1997). 

Counseling on the Information Highway: Future Possibilities and 
Potential Problems. Journal of Counseling and Development, 75, 
203-212 . 

Sampson, J. P. Jr., Krumboltz, J. D. (1991). Computer 
assisted instruction: A missing link in counseling. Journal of 
Counseling and Development, 69, 395-397. 

Sanderson, A., & Jemmott III, J. (1996) . Moderation and 




15 



Mediation of HIV-Prevention Interventions: Relationship Status, 
Intentions, and Condom Use Among College Students. Journal of 
Applied Social Psychology, 26. 

Santrock, j. w. (1996) . Adolescence, An Introduction, 6th 
Edition. Chicago: Brown & Benchmark. 

Shapiro, D. E., Schulman, C. E. (1996). Ethical and legal 
issues in e-mail therapy. Ethics and Behavior, 6, 107-124. 

Shapiro, E., & Shapiro, A. (May, 1989). Gilles de la 
Tourette's syndrome and tic disorders. The Harvard Medical 
School Mental Health Letter. 

Shore, K. (1986), The Special Education Handbook. New 
York: Teacher's College Press. 

Simanski, j. W. (1998) . The birds and Bees : An Analysis of 
Advice Given to Parents Through Popular Press. Adolescence, 33, 
33-45 . 

Smith, Ph,D., C., & Strick, L. (1997), Learning 
Disabilities A to Z . New York: The Free Press. 

Snow, J. T., & Harris, M. B. (1989). Disordered eating in 
Southwest Pueblo Indians and Hispanics. Journal of Adolescence, 
12, 329-336. 

State Specific Birth Rates for Teenagers -United States, 
1990-1996. (1997). Journal of the American Medical Association, 

278, 1143-1144. 

Steingard, R. , & Stout, D. (1992) . Tourette's syndrome and 
Obsessive-Compulsive Disorder. Psychiatric Clinics of North 
America, 15, 849-860. 

Stice, E., Schupak-Neuberg, E., Shaw, H. E. & Stein, R. I. 
(1994) . Relation of media exposure to eating disorder 
symptomatology; an examination of mediating mechanisms. Journal 
of Abnormal Psychology, 103, 836-841. 

Striegel -Moore, R. H., Silberstein, L. R. , & Rodin, J. 

(1986). Toward an understanding of risk factors for bulimia. 
American Psychologist, 41, 246-263. 

Substance Abuse and Mental Health Services Administration. 
(1997) . Preliminary results from the 1996 National Household 
Survey on Drug Abuse. SAMHSA. 

U.S. Department of Health and Human Services. (1988) . The 
health consequences of smoking: Nicotine addiction. A report of 
the Surgeon General. U.S. Department of Health and Human 
Services, Public Health Service, Centers for Disease Control, 
Office on Smoking and Health. DHHS Publication No. (CDC) 88-8406. 

U.S. Department of Health and Human Services. (1989). 
Reducing the health consequences of smoking: 25 years of 
progress: A report of the surgeon general, 1989. Atlanta: GA: 
Office on Smoking and Health, Centers for Disease Control and 
Prevention. DHHS Publication No. (CDC) 89-8411. 

U.S. Department of Health and Human Services. (1994a). 
Preventing tobacco use among young people: A report of the 
surgeon general. Atlanta, GA: Office on Smoking and Health, 
National Center for Chronic Disease Prevention and Health 
Promotion, Centers for Disease Control and Prevention, Public 
Health Service, U.S. Dept of Health and Human Services. 




16 



U.S. Department of Health and Human Services. (1994b) . 
Surveillance for selected tobacco use behaviors- United States, 
1990-1994. Morbidity and Mortality Weekly Report, 43 (SS-3): 

1-33. 



ERIC 



17 



U.S. Department of Health and Human Services. (1996) . 

Smoking cessation: clinical practice guideline No. 18. Rockville, 
MD: U.S. Department of Health and Human Services, Public Health 
Service, Agency for health Care Policy and Research. (AHCPR 
Publication no. 96-0692. U.S. Department of Health and Human 
Services. (1998) . Tobacco use among high school students- United 
States, 1997. Morbidity and Mortality weekly Report, 47, 229-233. 

U.S. Environmental Protection Agency. (1993). Respiratory 
health effects of passive smoking: Lung cancer and other 
disorders. The report of the Environmental Protection Agency. 
U.S. Environmental Protection Agency, Office of Research and 
Development. (EPA/600/6-90/006F) . 

Vinovskis, M.A. (1988) . An "Epidemic" of Adolescent 
Pregnancy. New York: Oxford University Press. 

Wagner, BA, T. H., Patrick, PhD, MSPH, D. L., Galer, MD, B. 
S., & Berzon, DrPH, R.A. (1996) . A New Instrument to Assess the 
Long-term Quality of Life Effects From Migraine: Development and 
Psychometric Testing of the MSQOL. Headache, 36 (8), 484-492. 

weaver, T. L., & Clum, G. A. (1993). Early Family 
Environments and Traumatic Experiences Associated with Borderline 
Personality Disorder. Journal of Consulting and Clinical 
Psychology, 61 (6), 1068-1075. 

wechsler, H., Rigotti, N. A., Gledhill-Hoyt , J., & Lee, H. 
(1998) . Increased levels of cigarette use among college 
students: A cause for national concern. Journal of the American 
Medical Association, 280 (19), 1673-1678. 

Wolpe, J. (1958) , Psychotherapy by reciprocal inhibition. 
Stanford, CA: Stanford University Press. 

Wymelenberg, S. (1990) . Science and Babies, Private 
Decisions, Private Dilemmas. Washington, D.C.: National Academy 
Press . 



18 




20 



Appendix A 



The Explosion of Psychological Help on the Net 
Electronic Behavioral Healthcare 

I. Information regarding treatment and research cutting edge, 
state of the art, expert information for consumers, breaking down 
the barriers between consumers and experts; NAMI 

Opportunities for "passive" learning 

A. Web sites 

B. Listserv groups 

C. Electronic Journals 

II. Interactive electronic treatment 

Opportunities for "active" learning 

A. Support groups 

B. Expert -mediated groups 

III. Referral to in vivo Psychotherapy 

IV. Outcome Evaluation: Follow up mechanisms & tracking usage 

A. what is lost without face-to-face contact? 

B. what is lost without continuity of a real relationship? 

V. Issues 

A. Privacy 

B. Accessibility 

C. Potential for abuse, exploitation 

VI . Model of Ideal Electronic Resources 

A. Clear & accurate information 

B. How to- suggestions for change; practical exercises 

C. Destigmatizing information; promotion of normalization 

D. Promote sense of belonging; combat loneliness 

E. Referral mechanism-if additional help is needed 

F. Outcomes assessment; feedback mechanism 
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Appendix B 

Original Evaluation Form 



Rater 

Resource 

Evaluation of Electronic Helping Resources 

Use the 5 -point scale described below to evaluate the resource on 
each of the following dimensions. 

0=absent 

i=extremely inadequate 
2= somewhat inadequate 
3=somewhat adequate 
4 =out standing 

A. Clear & accurate information 

B. How to-suggestions for change; practical exercises 

C. Destigmatizing information; promotion of normalization 

D. Promote sense of belonging; combat loneliness 

E. Referral mechanism-if additional help is needed 

F. Outcomes assessment; feedback mechanism 



Appendix C 

Revised Evaluation Form 



Evaluation Sheet 

Psych Help Resources (c)l998 

Rater Disorder 

Site Name 

Site 

Address 

Type of Site: General Disorder Class Specific Disorder 

Specific Other 

Site Motive: Informative Provide Help Commercial 

Other 



Use a four-point scale to evaluate the resource on each of the 
following dimensions. 

0 Absent 

1 Extremely Inadequate 

2 Somewhat Inadequate 

3 Somewhat Adequate 

4 Outstanding 

Clear and Adequate Information 

Practical Suggestions for change 

Destigmatizing Information; Promotion of Normalization 

Promote sense of Belonging; Combat Loneliness 

Referral Mechanisms 

Outcomes Assessment; Feedback Mechanisms 
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Appendix D 

Evaluation Descriptions 

1. Type of Site; example: General = "mental health site", 

Disorder Class Specific = "chemical dependency", Disorder 
Specific = "alcoholism". Other = written explanation. 

2. Site Motive; Informative = purely passing on information. 
Provide Help = suggestions for change, self- help, commercial = 
goal to obtain profit. Other = written description. 

3 . Clear and Adequate Information = Page is well written and easy 
to follow, no apparent gaps in information. 

4. Practical Suggestions for Change = How to's, 

5. Destigmatizing information; Promotion of Normalization = 
Personal accounts, success stories, inspiration. 

6. Promote sense of belonging, combat loneliness = chat lines, 
on-line support groups, and immediate access to others. 

7. Referral Mechanisms = contacts to community groups, and other 
Internet sites (non-interactive) Non cyber referrals. 

8. Outcomes Assessment; Feedback Mechanisms = counseling via the 
Internet only (e-mail or one on one chats with some one in a 
counseling position) Users access to information on own recovery 
rates. 
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